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Abstract 


Dynamic programming is a modeling technique used for the decision 
making process. This method can be used to find the set of nondominated 
paths in a network with time dependent vector costs. In this report a 
dynamic programming algorithm and its implementation are discussed. An 


application to a fire egress problem is also included. 
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1. Introduction — 

Dynamic programming is a versatile modeling technique that can be used for the decision 
making process. One class of applications involves finding the optimal path in a network. 
This type of problem has applications in fields such as transportation, telecommunications, 
computer architecture, and fire egress. When a network has more than one cost associated 
with it, there may not be a unique optimal path, but a set of nondominated paths. For this 
project, a dynamic programming algorithm was used to construct a program that finds the 
nondominated paths in a network with multiple costs. 

There were two main goals for this project. One was to learn about dynamic 
programming, its applications, and the recent developments in the field. The second wus to 
design a data structure to represent a network, implement the dynamic programming 
algorithm to find the nondominated paths, and run the program on a sample network. 

This report discusses dynamic programming and its extensions to vector cost functions 
and time dependent cost functions in sections 2, 3, and 4. Section 5 presents a users’ guide to 
the program that implements the dynamic programming algorithm for networks with vector 
costs. The extension of the program to work with time dependent vector costs is also 
discussed. In section 6, an application of the program to a problem in fire egress is presented. 
The code for the two programs can be found in Appendices A and B. Appendix C contains a 


sample input file for each program, while sample output files can be found in Appendix D. 


2. Classical Dynamic Programming 


Consider the directed graph G(NA), consisting of a set of N nodes N= {1,2,...,N} 
and a set of m links 2 = {(ij,12), (13,14), - ~~» Gam-1lam)}, where (j,k) denotes a connection 
from node j to node k. A path in the network from node ig to node ip is a sequence of links 


P= ((igsly)salli sto) oe (ip.1s1p)} where the initial node of each link is the terminal node of the 


previous link and the nodes ig,..., ip are distinct. Each link (i,j) has an associated 


nonnegative cost cj; to travel from node 1 to node j. 

The idea of finding the minimum cost path between two nodes in a network was first 
brought to everyone's attention by Bellman when he posed the routing problem (Bellman, 
1958): Given N cities, with everv two linked by a road, and the times required to traverse 
these roads, determine the path from one given city to another given city that minimizes total 
travel time. In this problem, the nodes in the network are the cities and the links are the 
roads connecting the cities. The cost we wish to minimize is the total travel time. 


Bellman presents a solution to this problem by establishing “functional equations” and 


applying “the principle of optimality.” First, let f; be the time to travel from node i to node N, 


i=1,2,...,N-1l and let fy = 0. The principle of optimality states (Bellman. 1965): “An 


dt } 


optimal policy has the property that whatever the initial state and initial decision are, the 
remaining decisions must constitute an optimal policy with regard to the state resulting from 
the first decision.” So if the optimal path from node i to node N passes through node Jj, this 
path includes the optimal path from node j to node N. Thus the routing problem can be solved 


in at most N-I iterations using the following method (k indicates the iteration:: 


f;(k) = MIN jj (Cij or fi(k-1)), = Le te Sy eneNet 


Fy(k) = 0. 
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To evaluate f;(), use an "initial guess” f,(0), i = 1, 2,...,N. This method, also known as 
backward dynamic programming, gives the minimum time required to travel from every city to 


city N. 


If one is interested in the optimal path from node 1 to every other node, the functional 


values fj, i= 1, 2,...,.N, represent the time to travel from node 1 to node i. The functional 


equations become 

f,(k) =0 

f,(k) = MiINjz) (fj(k-1) =e Ci), {= th a. eee 
This is referred to as forward dynamic programming, and node 1 1s called the “root node.” For 
this project, only the forward dynamic programming method will be considered. 

Although Bellman assumed that there are two links between every pair of nodes, with 
One in each direction, this problem can also be solved for networks that are not completely 
connected. The only requirement is that for every node i ,other than node 1, at least one path 
exists from node | to node i. 


The following diagrams illustrate how forward dynamic programming programming works. 


In the diagram below, we have the optimal path from node | to node 1 with a cost of f;. 


Figure 1. Optimal path from node | to node j 
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The cost to travel from node | to node j is the sum of f;, the cost to travel to node i, and cjj, the 


cost to travel along the arc (1,}). 


To find the optimal path to node j, one must consider all the arcs leading into node j. In 


the following diagram, p arcs from nodes il, i2,..., ip lead into node j. 


Two major extensions to the routing problem were used for this project. Hartlev (1984) 
considered the case of more than one cost on a link between earch pair of nodes. For 
example, one may wish to minimize both total travel time and total distance :raveled. The 
second major extension of the routing problem, as presented by Cooke and Halsey (1966), 
deals with costs that depend on time. 

Kostreva and Wiecek (1991) combine both of these ideas and present two aigorithms for 
finding the set of all nondominated paths in a network with time dependent vector costs. This 
project continues with that idea by providing an implementation of the rorsard dynamic 


programming algorithm for a network with time dependent vector costs. 


3. Vector Dynamic Programming 
In the case where several costs are associated with each link in a network, we can no 
longer find the minimum cost paths between two nodes. We must now find the nondominated 


paths. If there are p costs per link, define the costs to travel from node i to node j as the 
p-dimensional vector [cjj]. et [fj] represent the vector sum of the cost vectors for each link 
along a path from node i to node j. The objective for this problem is to find the set of 
nondominated paths from node 1 to a given node. A nondominated path from node i to node j 


with the vector cost [f;;"] has the property that no other path trom i to j has a vector cost [fj] 
such that [fijlk S [fij" Ik forrk Sol 26 rao p. with [fjj] # [fjj7]. For example. consider the 
two-dimensional vector cost [ci], where the first element [cil is the time to travel link (i,j) 


and the second element [cjj]> is the distance from i to j}. Among the vector costs [20,20], 
[10,20], and [15,10], the paths with costs [10,20] and [15,10] are nondominated. The path 
with cost [20,20] is dominated because 10 < 20 and 20 $ 20. Note that this path is also 
dominated by the path with cost [15,10]. Now consider three paths from i to j with cost 
vectors [10,15], [15,10], and [11,11]. All three paths are nondominated, including the one 
with cost [11,11]. An algorithm tor finding the cost vectors of nondominated paths is ziven by 
Corley and Moon (1985). 

In order to find the set of nondominated paths, consider the functional values { (fl). which 
represent the set of all vector costs for nondominated paths from node 1 (the root node) to 
node j. The functional equations for vector dynamic programming are 


((f1} = (Q} 


Eee NIN teen lil) elCileindes 25 Seka 


where A is the set of links in the network and the operation VMIN determines the set of 


vector costs for all nondominated paths. 


The principle of optimality for this case states that if a nondominated path from node 1 to 


node j passes through node i, then the path from node | to node i is nondominated. The 


algorithm for forward vector dynamic programming follows: 
SF ERs 
Initralize s6( fl adie sezats eae N; 

({f,]} = (0) 

(( fj] } =[c)J if (Lj)e a 


((£,(]} = [M] if (1,j) € 2 


where [M] is the "big-M” vector (M,..., M)! with M equal to a very large cost. 
STER.2 
Fork =1,2,..., N-1, find the new functional values 


({£,40]} = (0) 


((f]} = VMING) ea { {[%-)) + [cy] },j=2,3,...N. 


Note that this algorithm only computes the functional values tor the nondominated paths. To 


find the actual paths, one must simultaneously keep track of the sequence of links (or nodes: 


associated with each functional value. 


4. Time Dependent Vector Dynamic Programming 

If the vector dynamic programming problem is extended to take into account costs that 
vary with time, we get time dependent vector dynamic programming. Using the frozen link 
model, the costs to travel link (i,j) depend on t, the time of departure from node i. This is 


denoted as the vector [cj j(t)]. For this project, all time dependent cost functions are step 


functions. To simplify computation, the time it takes to travel a link (i,j) will be the first 


element of the vector [c,j(t)]. 

Without loss of generality, several other assumptions are made to simplify this problem. 
Time starts with the departure from the root node at t = 0 and increases trom there. There is 
no waiting at any node, so the arrival time at a particular node is the time of departure trom 
that node. Two more assumpions show that all of the elements of the cost vectors, in 
addition to time, are monotonically increasing. These assumptions are also necessary to 


formulate the principle of optimality for the time dependent case: 


For t; St 
(a) ty + [eyj(ty)]) Ste + [ej(t2))] 
(b) [e4j(ty)]r < [cjj(t2)]r, T1235. eam, 
-\ssumpuon (a) shows that if someone leaves a node at time t; and someone else ‘eaves the 


same node at a later time to, the person who left later cannot pass the first person and be the 


first to arrive at node j. Assumption (b) shows that there is no advantage to waiting ata 
node because leaving at a later time will not result in a lower cost to travel a link. It can be 
shown that assumption (b) 1s stronger than assumption (a), as (b) implies (a) but (a) does 


not necessarily imply (b). 


The principle of optimality for this case (Kostreva and Wiecek, 1991) states that “a 
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nondominated path p, that leaves the origin node at time t = O and arrives at node j at time js 


has the property that for each node 1 lying on this path, a subpath p; that leaves the origin 
at time t = 0 and arrives at node i at time tj, tj S tj, is nondominated.” 


The functional values for this problem are given by {[f,]}, the set of vector costs for the 
associated set of nondominated paths from node | to node i. The algorithm for time 


dependent vector dynamic programming follows: 


STERal 

Inidalizea [tase y ees 
({f\9]} = (0) 
[Fj] } = (c),(0)] if 1j)e A 
(({f}(]} =(M] if (1,j)€ a 

STERS 


Fork =1,2,..., N-1, update the functional values 


({f,)]} = {0} 
ELF 1) SV MING ee LE BI Jali (hh i= 253 een 
where t; = [f,(*-1)],, the time of arrival at node i for the particular path to node i. 


Once again, these values are the vector costs of the nondominated paths. The actual 


paths must be found simultaneously. 


5. Implementation 

The forward dynamic programming algorithm for a network with constant vector costs was 
programmed first and then the algorithm was modified for networks with time dependent 
vector costs. Both programs were fone on the Apple Macintosh IICX. The program for the 
constant cost networks is called DP while the time dependent version is called TD. Both 
programs use an input file called NETWORK.DATA that specifies the network to be 


optimized. Both programs create an output file NETWORK.OUTPUT that contains the 


nondominated paths and their associated costs. 


5.1 The Input File 


The user defined input file NETWORK.DATA contains the information necessary to 
specify the network. The first three values in the file are integers for the number of nodes in 
the network, the number of links in the network, and the number of costs per link. The next 
three sets of values make up a link list. The first is a list of integers that serve as pointers. 
For a network with N nodes and M links, N+1 pointers should be used, starting at 1 and 
increasing to M+1 so the number of links entering a node 1 can be calculated by subtracting 
the ith pointer from the (i+1)S¢ pointer. 

The next set of values is a list of M integers that represent the starting node i for each 
link (i,j) in the network. The final set of values is a list of M real-valued vectors that give the 
costs to travel each link. 

There are two details that should be pointed out about the input file. If there are N nodes 
in the network being used, they should be labeled as nodes 1, 2,...,N, with node | being the 
root node. This is necessary since the information about the links leading into node i !s round 
by using the i pointer. 


It is also important to remember that every node must be accessible from node 1. If not. 
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the program will enter an infinite loop. If a network does not meet this requirement, one can 
always add links with extremely high costs so at least one path exists from node 1 to every 
other node. A link (i,j) with a high vector cost will indicate an infeasible path to node j and 
prevent paths to other nodes from passing through node j. 


As an example of how to construct this data file, consider the following network with six 


nodes, nine links, and two-dimensional cost vectors. 


Figure 3. Sample network 


W4 


It is helpful to construct a table similar to the following in order to determine the values to 


enter into the data file. 


Node 


] 


Ww 


(7) 


Pointer 


1 


LS») 


10 


Start Node Cost 
l (2255 
2) (2,2) 
l (352) 
2 (253) 
3 (4,3) 
5 es) 
2 (4,3) 
4 (2,4) 
5 (352) 


eeeenmeeceenoce = occrcenrce 


Notice that node 1 does not have any entering links. Thus no starting nodes or costs are 


entered. Also note that the seventh value in the pointer column is 10. Even though there is 


not a node 7, this value is necessary to determine how many links lead into node 6. 


ay 


The data file for this particular network would look like this (comments added): 


692 number of nodes, number of links, number of costs per link 
W115. 4.7810 : a pointer list 
Ww"1 235245 start node list 
25 costs for link (1,2) 
Da costs for link (3,2) 
Stes ; 

ae} 

43 : 

12 

43 . 

24 costs for link (4,6) 
ae costs for link (5,6) 


Two more sample input files can be found in Appendix C. 


5.2 The Main Program 

The purpose of this section is to help anyone who continues to work with the programs 
DP and TD by describing the code for DP and the changes that were made to produce TP. 
The variable names used in the program are referred to in this description to keep maximum 


consistency. The following table describes the variables used in the main program. 


Variable Description 

N the number of nodes in the network 

NMAX the maximum number of nodes in the network 

M the number of links in the network 

MMAX the maximum number of links in the network 

Cc the number of costs per link 

CMAX the maximum number of links 

PMAX an estimate of the maximum number of vectors that will be 


compared when finding a set of nondominated paths 


Variable Description 

PTR PTR(i) indicates where to find the starting nodes of 
links leading into node i and their cost vectors 

STNODE a list of starting nodes for the M links in the network 

COse COST(i,j) is the j!® cost component of link i 

K the’currént iteration (k= 1, 2, 29) N=1) 

PCOUNT PCOUNT(i) is the number of nondominated paths leading 


into node i before each iteration 
CCOUNT CCOUNT(1) is the number of nondominated paths leading 
into node i during each iteration 


PPREV PPREV(i,j,k) is the k"" node in the j nondominated path 
from node | to node 1 before each iteration 
PPREV(i,j,1) is the number of links in the j!" path to node i 
PCURR PCURR(i,j,k) is the k"" node in the j" nondominated path 
from node | to node i during each iteration 
PCURR(i,j,1) is the number of links in the j') path to node i 


FPREV FPREV(i,j,k) is the kt® element of the functional value for 
the j'® path from node 1 to node i before each iteration 
FCURR FCURR(i,j,k) is the k"® element of the functional value for 
the j‘) path from node 1 to node i during each iteration 
MATRIX the set of cost vectors that are used to determine the set of 
nondominated paths from node 1 to a particular node 
PMAT the set of paths for the cost vectors in MATRIX 


The values NMAX, MMAX, CMAX, and PMAX are specified in parameter statements at 
the beginning of the main program and the subprograms that use those parameters. These 
values are used to dimension arrays used throughout the program. The current values are 
NMAX=20, MMAX=100, CMAX=4, and PMAX=50. If the value of CMAX needs to be 
increased, in addition to changing the appropriate parameter statements, one should also 
change format statement number 999 in the main program and format statement number 100 
in the subroutine OUTPUT to allow more than four cost elements to be printed on one line. 

The program DP begins by reading in the network from NETWORK.DATA and initializing 
the functional values and path counts. The subroutine READ initializes N, M, and C and the 


arrays PTR, STNODE, and COST. The values for PCOUNT(1) and CCOUNT(1) are set to 1 
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as it is assumed that there is exactly one path from node 1 to itself. The functional values 
FPREV(1,1,i) is set to 0 fori=1toC. All other values in the PCOUNT array are initially set 
to | while the functional values for FPREV(i,1,j), 1 = 2 to N, j = 1 to C, are initially set to the 
value BIGM. This number should be large enough so that in the early stages of the 
algorithm, say iteration k, when no paths from node | to node i have k or fewer links, this path 
will have such a large functional value that it will not be selected as a nondominated path. 
The path array PPREYV is initialized to contain all zeros since no paths exist yet. 

The next step in the program is to change the values of FPREV and PPREV for which the 
links (1,i) exist. For i = 1 to M, if STNODE(i) equals 1 the functional value and path must be 
reinitialized for that link. The index j for that particular link is found using the array PTR. 
Then FPREV(j,1,A), A = 1 to C, is set to COST(I). Since there is only one link in the path | 
trom node | to node I, PPREV(J,1,1) is set to 1. 

Once the functional values and paths have been initialized, the dynamic programming 
algorithm iterates N-1 times. For K = 1 to N-1, the functional values and paths for nodes 2 
through N are updated. For I = 2 to N, the links leading into node I are found. To identify 
these links, start a third loop for J = PTR(I) to PTR(I+1) - 1. Then start a fourth loop for each 
nondominated path from node 1 to the starting node of link J. For A = 1 to 
PCOUNT(STNODE(J)), find the cost to travel from node 1 to node I along path A by adding 
FPREV(STNODE(J),A,B) and COST(J,B), B = 1 to C. These functional values are put into 
MATRIX and the corresponding paths are put into PMAT. The value of MATRIX(Z,B) is the 
Bth cost element of the Z'th path from node 1 to node I, which equals 
FPREV(STNODE(J),A.B) + COST(J.B). PMAT(Z,1) contains the number of links in the 
path from node | to node I. This equals PPREV(STNODE(J),A,1) + 1. The B'® node along 
this path is put in PMAT(Z,B), which is found from PPREV(STNODE(J),A,B) for B = 2 to 


PMAT(Z,1) - 1. The last node in the path is STNODE(J), which is put into 


ie’ 
PMAT(Z,PMAT(Z,1)). 

Now that a matrix containing all the paths from node 1 to node I that use the 
nondominated paths from the previous iteration and a matrix containing the corresponding 
functional values have been constructed, the subroutine VMIN will use the functional values 
in MATRIX to determine the updated set of nondominated paths from node 1 to node I. The 
number of nondominated paths is returned in the variable NUM while the paths themselves 
are returned in the two-dimensional array PSOL. The functional values for these paths are 
returned in the matrix SOLN. The current count of nondominated paths from node 1 to node I, 
CCOUNT(I) is set to NUM. For each nondominated path A = 1 to COUNT(I), the current 
functional value FCURR(I,A,B) is set to SOLN(A,B), B = 1 to C. The current path PCURR 
is also updated by PCURR(I,A,B) = PSOL(A,B) for B = 1 to N-1. Finally, the functional 
values for path A to node I are sent to the output file NETWORK.OUTPUT. 

Once the loop for node I = 2 to N is completed, the previous values for the counts of 
nondominated paths, the nondominated paths themselves, and their functional values are 
updated by setting PCOUNT = CCOUNT, PPREV = PCURR, and FPREV = FCURR before 
going to the next iteration of the algorithm. 

Once the N-1 iterations of the forward dynamic programming algonthm are complete, the 
final results containing all nondominated paths from node 1 to every other node, with costs, 


are sent to NETWORK.OUTPUT through the subroutine OUTPUT. 


5.3 The Output File 

The output file NETWORK.OUTPUT contains two parts. The first consists of all 
functional values for iterations | through N-1 of the algorithm. Functional values are given for 
each path leading from node 1 to node i, 1 = 2, 3,...,N. 


The second part of the output file is a list of each nondominated path from node | to every 
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other node along with the cost to travel each path. The path from node 1 to node 1 is © 
represented by a sequence of links leaving node 1 and ending at node 1. Sample output files 


can be found in Appendix D. 


5.4 Subprograms 

The main program calls three subprograms, READ, VMIN, and OUTPUT. The subroutine 
VMIN calls three other subprograms, VCOMP, VEQUAL, and PEQUAL. When the 
subroutine READ is called, the files NETWORK.DATA and NETWORK.OUTPUT are 
opened. The number of nodes in the network, N, the number of links in the network, M, and 
the number of costs per link, C, are then read from the data file. Then the N+1 pointers are 
read into the list PTR, followed by STNODE, the list of starting nodes for each of the M links. 
The last set of datato be read is the two-dimensional array COST. For each link 
PSP 2, o,, M, COS TELB) ts read for B—El 2708 2, €. 

The subroutine OUTPUT writes the cost of each nondominated path from node | to every 
other node followed by the path itself to the file NETWORK.OUTPUT. The procedure starts 
with the path from node 1 to node 1, the link (1,1), with a cost of 0. Then forI =2,3,...,N, 
the nondominated paths from node | to node I are sent to the output file. For J = 1 to 
PCOUNT(I), the vector cost FCURR(I,J,K), K = 1 to C, is written to NETWORK.OUTPUT. 
Then the path is written link by link, starting from node 1 and ending at node I. 

The subroutine VMIN determines the set of nondominated vectors from the 
two-dimensional array MATRIX. Values for R, the number of vectors in MATRIX, VIN, the 
matrix itself, and PIN, the set of corresponding paths, are passed to VMIN. ‘«shich then 
returns NUM, the number of nondominated paths, POUT, the paths themselves. and VOUT, 


the vector costs corresponding to these paths. 


ds 
The algorithm for VMIN which appeared in the Journal of Optimization Theory and 
Applications (Corley and Moon, 1985) is given below. The set vmin V represents the set of 


vector minimums from the r input vectors. 


Step 1. Seti=1,j=2. 


Step 2. Ifi=r- 1, goto Step 6. If vj < vj, go to Step 3. If vj < vj, go to Step 4. 
Other wise, go to Step 5. 

Step 3. Seti=i+1,j=1+1; goto Step 2. 

Step 4. Setv; =v,,r=r- 1; go to Step 2. 


J 


Step 5. Ifj=r, put v;€ vmin V, and goto Step 3. Otherwise, set j =j + 1, and 
TOU Siep 2. 


Step 6. If vj <vj, put vj € vmin V, and stop. If vj S vj, put vj € vmin V, and stop. 


Otherwise, put v;, vj € vmin V, and stop. 

Three changes were made to this algorithm to implement itin VMIN. First, the algorithm 
was adjusted to handle the case when only one vector is sent to VMIN. That vector is 
returned as the only nondominated vector. The second change was made so that the 
algorithm will not discard paths that have a vector cost identical to another path. This was 
accomplished by discarding vectors that were greater than or equal, but not identically equal, 


to some other vector using the logical function VCOMP. The third change was necessary to 


prevent the algorithm from terminating prematurly in certain cases. It is mecessarv to check 
tor the case where j =r in step 4. If j =r, then set] =j- 1. Otherwise, set vj =v,. With 


these three changes, the VMIN algorithm becomes: 


Step 0. Ifr=1, put v,; € vmin V, and stop. 


Slepals wocidi=al fare. 


Step 2. Ifi=r- 1, goto Step 6. If Vj S Vj, (Vj # Vi), £O tostep a. ali, = Vj, (Vj # Yj), 
go to Step 4+. Other wise, go to Step 5. 
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Step 3.) Set Pails | =r), cotomtep 2: 
Step 4. Ifj=r,setj =j- 1. Otherwise, set Vj = Vr. Setr=r- 1; go to Step 2. 


Step 5. Ifj =r, put v;€ vmin V, and go to Step 3. Otherwise, set j =} + 1, and 
go to Step 2. 


Step 6. If vj < vj, (vj # vj), put vj € vmin V, and stop. If vj < vj, (vj # vj), put vj € vmin V, 
and stop. Otherwise, put vj, vj € vmin V, and stop. 


Another point that should be made is that besides putting each nondominated vector into 
VOUT, the paths associated with these vectors are put into POUT at the same time. The 


count for the number of nondominated paths is also incremented at this time. 
In order to compare the vectors v; and v;, VMIN uses the logical function VCOMP. The 


matrix VIN with its dimensions R and C, and the indices I and J are passed to the function. 
VCOMP(MATRIX,I,J.R,C) returns .TRUE. if vector I of MATRIX is less than or equal, but 
not identically equal, to vector J of MATRIX and .FALSE. otherwise. 

The function starts by checking for equality of the two vectors. If they are equal, FALSE. 
is returned. Once an element of vector I is found that does not equal the same element in 
vector J, the function looks for an element of J that is greater than the same element in vector 
I. If one is found, .FALSE. is returned. Otherwise .TRUE. is returned. 

VMIN uses the subroutine VEQUAL to set one vector cost equal to another. 
VEQUAL(MAT1,I,MAT2.J,C) will set column I of the matrix MAT1 equal to column J of the 
matrix MAT2. The dimension of the vector is given by C. 

VMIN also uses the subroutine PEQUAL to set one path vector equal to another. 
PEQUAL is identical to VEQUAL except that PEQUAL is used for the integer-valued 


vectors representing the paths while VEQUAL uses real-valued vector costs. 


5.5 The Time Dependent Algorithm 

The modified program TD required very few changes to take into account time dependent 
vector costs. There were two modifications to the COST data structure. The first element of 
the vector cost for a link is specified to be the time required to travel that link. The second 
change results from the use of step functions for the time dependent costs. Three parameters 
must be used in the input file NETWORK.DATA to define the costs on each link: LCOST, 
the lower vector cost, UCOST, the upper vector cost, and T(I), the time where the costs rise 
from LCOST to UCOST for link I. Recall that LCOST < UCOST. If the costs for a particular 
link I remain constant over time, LCOST can be set equal to UCOST or T(I) can be set to 
zero. 

A new variable TIME is needed to determine what part of the cost function should be 
used for a particular link. If one wants to travel link (i,j), TIME is set to the first element in 
the functional value for the particular path leading to node i, which is the time required to 
travel that path to node 1. 

When the functional values are initialized for nodes that have links entering from node 1, 
the values should be set to the values of the lower step LCOST. 

The last modification was made in the calculation of the cost to travel a certain path from 
node | to node 1. When constructing the cost matrix to send to the VMIN procedure, the 
function COST is used to determine the cost to travel the last link in the path to node i. 
COST(I,J, TIME,LCOST,UCOST,T) returns the J cost element of link I at time TIME for the 
step function defined for link I. This function returns LCOST(I,J) if TIME is less than T(I) 
and UCOST(I,J) otherwise. 

The format for the output file NETWORK.OUTPUT remains the same as in the previous 


program. Sample input and output files can be found in Appendices C and D. 
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6. Application 

One of the applications of dynamic programming mentioned earlier was that of fire egress. 
If a building is represented as a network, where each room is a node and rooms that are 
connected have links connecting the nodes, one might be interested in the optimal paths from 
each room to exit the building in order to plan fire escape routes. The solution set for this 
problem is the set of nondominated paths from every room to the outside. One node would be 
located outside the building and each room with a door or window leading outside would have 
a link to that node. The cost for this problem consists of two components: time and distance. 
One can expect these costs to increase during a fire, so these costs will depend on time. 

The information desired from this problem is the set of optimal paths from every room in 
the building to the outside. This suggests that the backward dynamic programming method 
be used to solve this problem. However, when time dependent costs are taken into account, 
the backward method will not work without making adjustments to the problem (Kostreva 
and Wiecek, 1991). The reason backward dynamic programming becomes complicated is that 
the costs to get from one node to another depend on the time of departure, which starts at 
zero and increases from there. Going backward, one starts at the outside node, where the 
urrival time is unknown. The cost to travel a link (i,j) cannot be determined since the time of 
departure from node i is unknown. The solution for a fire egress problem can be found by 
repeating the forward dynamic programming algorithm for each room in the building. Although 
there is excess information generated, this is still more efficient than the backward method 
(Kostreva and Wiecek. 1991). 

This particular application uses a building with fifteen rooms. The cost functions on some 
of the links are step functions while the other links have constant costs. The network below 


represents the building. The table that follows gives the time and distance to travel between 


the rooms. 


Figure 4. Network for fire egress example 
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Link ost 

aval Liti<e) 
(11,10) { 

((3,2) ift>5 
(lias) (1275) 

((3,3) ift<5 
(12,10) 4 

(6,4) ift>5 

((3,3) ift<5 
(13,10) { 

l(6,4) ift>5 
(13,14) (100,100) 
(14,13) (6,2) 
€1 5711) (100,100) 
(15,16) (5,3) 


Notice that on certain links, such as (4,5) and (6,7), the costs are set to (100,100). This is to 
insure that a path will not lead to a dead end, which is undesirable when planning fire escape 
routes. Also note that the fire occurs in room 4 at time t = 3 and spreads to rooms 8 and 10 at 
time t =5. 

Before solving this for the time dependent case, the nondominated paths were found for 
leaving the building when there is no fire. Since this is not a time dependent problem, it was 
solved using one iteration of forward dynamic programming on a similar network. Let node 1, 
the root node, represent the outside and node 16 represent room 1. Reverse all of the links, 
so link (i,j) becomes link (j,1). The upper step of each cost function is ignored while the lower 
step will be used for the costs to travel each link. The output for this program ts interpreted 
by replacing node | with node 16 and vice versa, reversing the links, and reversing the order 
of the links in the path to obtain the nondominated paths from every room to the outside. The 


results are given in the following table. 
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Node Cost Path 
1 an (1,16) 
a oh (2,16) 
3 4,4 (3 41),961 516) 
4 74 (4,6), (6,16) 
5 8,5 (5,4), (4,6), (6,16) 
6 ee (6,16) 
7 4,3 (7,6), (6,16) 
8 7 (8,16) 
8 5,4 (8,9), (9,16) 
9 pAge (9,16) 
10 11,9 (10,4), (4,6), (6,16) 
1] | yen 08, (11,10), (10,4), (4,6), (6,16) 
1] 17,8 CEPT s(1o.00) 
12 14,12 (12,10), (10,4), (4,6), (6,16) 
13 14,12 (13,10), (10,4), (4,6), (6,16) 
14 20,14 (14,13), (13,10), (10,4), (4,6), (6,16) 
15 See C1310) 


This method of using forward dynamic programming on a transformed network to obtain the 
nondominated paths to a particular node from every other node is a concept that seems to 
work on networks with constant costs, but will not be proved in this paper. 

To solve the problem for the time dependent case, it was necessary to run the program 
fifteen times using each node, except 16, as the root node. Since the program TD uses node |. 
as the root node, node | and node k were switched for k = 2, 3,.. s 15 to make fifteen 
different networks. The input file NETWORK.DATA was reconstructed for each case to 
build an appropriate data structure. For each execution of the program, the only pertinent 


information from the output file is the set of nondominated paths from node | to node 16. The 


See 


results are summarized below. 


Node Cost Path 
l ve (1,16) 
2 oe Gann Oy) 
3 4,4 (jaa el 6) 
4 7,4 (4,6), (6,16) 
5 8,5 (5,4), (4,6), (6,16) 
6 ee (6,16) 
7 4,3 (7,0), (0,16) 
8 el (8,16) 
8 5,4 (3-9) ei. LO) 
9 Dis (9,16) 
10 11,9 (10,4), (4,6), (6,16) 
11 12,10 (11,10), (10,4), (4,6), (6,16) 
11 17,8 C115) eC t 0) 
12 18,14 (12,10), (10,4), (4,6), (6,16) 
12 21,12 CI2F1O)s CIOS By, CLTaL Sy (15,16) 
13 18,14 (13,10), (10,4), (4,6), (6,16) 
13 zy Gio LO} ClO et higi5).4015) 16) 
14 Lhe (14,13), (13,10), (10,4), (4,6), (6,16) 
14 BUSL oO CES, PSS C0) 8 (LOTR A il, 15).0(.15,16) 
15 3 (15,16) 


Comparing these results to those for the constant cost case, one finds that the only 
differences are that the costs to leave from rooms 12, 13, and |4 have increased and there are 


two nondominated paths from each of these rooms to choose from to get outside. 
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7. Recommendations for Further Research 

The dynamic programming algorithm has been implemented to find the nondominated 
paths in networks with vector costs and in networks with time dependent vector costs. To 
accomplish this, a data structure ine link lists was used to represent the network. The cost 
functions for the time dependent case are step functions. 

Four improvements could be made to these programs to make them more versatile. The 
first two deal with the network data structure. The current method of reading the network 
into the program requires the user to construct the link lists by hand and put the data into the 
input file. For large networks, this can be time consuming and the chance of making a 
mistake increases. It would be desirable to have a subprogram to read in a simpler network 
structure from the data file and then convert the data to the link list data structure. 

The second modification could improve efficiency in time dependent applications like the 
fire egress problem where one would like to know the nondominated paths from every node to 
node 1. As the program stands, node 1 is the root node. This means that the user must run 
the program N-1l times, recreating the network data structure each time. Rather than 
requiring node 1 as the root node, it would be helpful to let the user choose the root node or 
have the program loop through nodes | to N-1 as root nodes. 

‘nother improvement could be made to the path array in order to make a more efficient 
use of the available memory. As the programs stand, the array for a particular path contains 
the number of links in the path and all the nodes the path goes through except node | and the 
last node. But because of the principle of optimality, the only node that needs to be stored is 
the second to last node the path passes through. This could be an advantage when running 
the program for a large network where there may be many nondominated paths that are 
stored. If this change is made, the procedure OUTPUT will have to be modified to write the 


results to an output file. Rather than listing the nondominated paths from node 1 to node j, 


oy 
j =2,...,N, the paths containing one link should be written first, followed by the paths with 
two links, on up to the paths containing N-1 links (if any). 

A fourth improvement would be to allow the use of time dependent cost functions other 
than step functions. This could be done by levting the user specify the cost functions for each 
link in the input file or by defining the function COST to use specific cost functions. 

With these improvements, the program would require less of the user and allow for the 


solution of more realistic path planning problems. 
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THIS PROGRAM FINDS THE NONDOMINATED PATHS IN A NETWORK WITH VETTOP 
COSTS USING FORWARD DYNAMIC PROGRAMMING. 


VARIABLES 
N NUMBER OF NODES IN THE NETWORK 
M NUMBER OF LINKS IN THE NETWORK 
C NUMBER OF COST COMPONENTS TO A LINK 
PTR PTR(I) TELLS WHERE TO LOOK IN STNODE FOR LINXS 
LEADING TO NODE I 
STNCDE STNODE(J) GIVES STARTING NODE OF LINK J 
COST COST (1,U), IS THE JTH COST COMPONENDE «OF. Re = 


PCOUNT (CCOUNT) PCOUNT(K) (CCOUNT(K)) iS THE NUMBER Cr UCM Ass 
THAT LEAD INTO NODE K BEFORE eee BACs wo 

PPREV (PCURR) PERE (Leis hymePCURR(C Ll, tc) Juco ples KOCH NODE Oi Tis 
JTH NONDOMINATED PATH FROM 1 TO = BEFCRE (DURING) 
EACH ITERATION 

NOTE: PPREVil, J,1) “(PCURR (Tj, 1)) 25 

JTH NONDOMINATED PATH FROM 1 TC 
EACH ITERATION 

FPREV (FCURR) EPREV(L,;J,K) (FCURR(I,J,K)) IS THE FUNCTIONAL JAS CF 
THE KTH COST COMPONENT FOR) THE Jia yada, 20 
NODE I BEFORE (DURING) EACH ITERATICN 


2 tu 
ts jy 


se ‘(SUE ivan «6 6) 


EMPL.GoIT NONE 
ZNTEGER N, NMAX, M, MMAX, C,. CMAX, PMAX, 1£,J5,K,A,3,2,7, 20 
PARAMETER (NMAX=20, MMAX=100, CMAX=4, PMA=50) 
INTEGER PTR(NMAX+1), STNODE (MMAX), PCOUNT(NMAX), CCOUNT (2DMA“) 
Bae PPREV (NMAX, >MAX, NMAX-1), PCURR(NMAX, PMAX, NMAZ--) 

TEGER PMAT (PMAX, NMAX-1), PSOL (PMAX, NMAX-1) 
REAL BIGM, MATRIX (PMAX, CMAX), SOLN(PMAX, CMAX), COST (MMA, CMAX, 
REAL FPREV (NMAX, PMAX, CMAX), FCURR(NMAK, 2MAX, CMAX) 


READ IN NETWORK 
BIGM = 100.0 
CALL’ READ (N,M,C, PTR, STNODE, COST) 


INITIALIZE PATH COUNTS AND FUNCTIONAL VALUES 
SCOUNT (1) =°3 


= 
- 
ll lat dee ae) = 1 
CGoUW ws ) — ore 


BO Dynal 5-C 


>COUNT (I) =1 
DO 20 J=1,C 
EPREV (1,1,J).=,BIGM 
CONTINUE 
CONTINUE 


INITIALIZE PATHS 
UGe29;l=1,N 
SC +22. c= lpn 
PPREV(I,1,J) = 0 


CONTINUE 

GesA LINKa(l, J) EXISTS seRELNITIALIZE SYNGTTONALAVALUS ANDesad = 
J -= a) 
DO 30 I=1,M 


Liter NODE. (1) EQ. 1) THEN 
VEO(PIRAUt Leto rou ly ol REN 
DO 40 A=1,C 
FPREV(J,1,A) = COST(I,A) 


( 
! 
¢ 
' 
' 
I 


40 CONTINUE .- 
PPREV(J,1,1) =1 


ELSE 
J = J+l 
GOTO 50 
ENDIF 
ENDIF 
30 CONTINUE 
C FORWARD DYNAMIC PROGRAMMING 
C YEED N-1 ITERATIONS 


DO 60 K=1,N-1 
WRITE (6, *) 
WRITE (5,900) a 
WRITE (6,997) 


c FOR NODES 2 TO N 
DO 70 I=2,N 
‘ FOR EACH LINK (J,2) 
Z= 0 
50 30 J=PTR(Z),PTR(I+1)-1 
c AND FOR ZACH PATH TO NODE J 
50 90 A=1, PCOUNT (STNODE (J) ) 
FIND COST OF ZACH PATH TO NODE I 
Z = 2+i 
DO 100 B=i,C 
MATRIX(Z,B) = FPREV(STNODE(J),A,8) + 
200 CONTINUE 
c ADD ONE TO THE COUNT OF NODES PER 
PMAT(Z,1) = PPREV(STNODE(J),A,1) + 1 
C GET NODES IN EACH PATH TO NODE J 
DO 105 B=2,PMAT(Z,1) - 1 
PMAT(Z,3) = PPREV(STNODE(J),A,3) 
2G CONTINUE 
2 ADD LAST NODE FOR NEW PATH 
PMAT(Z,2MAT(Z,1)) = STNODE (J) 
30 CONTINUE 
30 CONTINUE 
c FIND VECTOR MIN OF ALL PATHS 
CALL VMIN(Z,C,N-1,NUM, MATRIX, DMAT, SOLN, PSOL) 
c UPDATE COUNT OF PATHS TO NODE = 
CCOUNT(I) = NUM 
E FOR EACH 227 
DO 110 A=1,NUM 
e UPDATE FUNCTIONAL VALUES 
DO 120 B=1,¢ 
FCURR(I,A,3) = SOLN(A,3) 
120 CONTINUE 
c AND UPDATE PATE 


DO 125. B=1,N-1 
PCURR(I,4,3) = PSOL(A,B) 
Leo CONTINUE 


Cc OUTPUT NODE, PATH NUMBER, AND FUNCTIONAL VALUES 
WRITE (6,999) I,A, (FCURR(I,A,B),8=1,C) 


110 CONTINUE 
70 CONTINUE 
C SET PCOUNT = CCOUNT, FPREV = FCURR, AND PPREV = FCURR 
DO 65 I=2,N 
PCOUNT (I) = CCOUNT (TI) 


DO 66 A=1,CCOUNT (I) 
DO 67 B=1,C | | 
FPREV(I,A,B) = FCURR(I,A,B) 


67 CONTINUE 
DO 68 B=1,N-1 
PPREV(I,A,B) = PCURR(I,A,B) 
68 CONTINUE 
66 CONTINUE 
65 CONTINUE 


GO TO NEXT ITERATION 
CONTINUE 
PORMAT ("I TERATION’', 14) 
FORMAT (' NODE ATH NUMBER FUNCTIONAL VALUES ') 
pain? (ey LS) Ae.) 


OW wWwoanngnd 
Ww o 
J oo 


Ww 


Damse Selon Ola NEO NORA. ULE UL 


8) 
a) 


eamemoll eT (N,M,C, CURR, COUNT, 2CURR) 


=ND 
Cc MAIN PROGRAM 


suemCUL Ne READ{(N, M, C, PTR, STNODE, COST) 


mas SUSROULTINE READS IN THE NETWCRK FROM THE FILE 'NETWCRK.OATA' 


mee 


(2) 


Boe sag ai) oN 

Sere pA, MRA, BCPA, Ngee, C, 2, J 
PARAMETER (NMAK=20,' MMAX=100, CMAK=4) 
INTEGER PTR(NMAX+1), STNODE (MMAX) 

SEAL COST (MAX, CMAX) 


OPEN (2,7ILE='NETWCRK.DATA') 
SEEN (6, >ILE='NETWORKX.OUTPUT' ) 
. READ NUMBER OF NODES, NUMBER Cr LINKS, AND NUMBER OF COST CUMPCNENTS 


REawit25.© ) YN, SC 


READsPCINTER~LIST 


es teen | WE a pe se gt ed 


- 


* READ STARTNODE LIST 
READ (2,*) (STNODE (I) ,i=1,M) 


(@) 


READ IN COST OF EACH L 
50 = I=1,M 
READ(Z,*) (COST(I,J),J=1,C) 
30 CONTINUE 
a2. USN 


=ND 


CHERG OO 


SUBROUTINE OUTPUT(N, M, C, FCURR, PCOUNT, PCURR) 


WRITES RESULTS TO 'NETWORK.OUTPUT' 


IMPLICIT NONE 

INTEGER NMAX, MMAX, CMAX, PMAX, N, C 
PARAMETER (NMAX=20, MMAX=100, CMAX=4, PMAX=50) 
INTEGER PCOUNT (NMAX), PCURR(NMAX, PMAX, NMAX~-1) 
REAL FCURR (NMAX, PMAX, CMAX) 


ENT SGERSLY0, &; U 


RISE ORs) 
WRITE (6,100). 1, (FCURR(2,1,K) ,K=1,C) 
NRETE Cop Leas 
cDO 10 I=2,N 
DO (20) J=sl  PCOUNT fi) 
EOP eo Fay, 


Whe. (5,200). 37. (2 Conti, Je), 

SSP HPCORR (ipo; =) Vases Pay ee 
Epis Beep old ay, Pee) Paes 
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CURR toro re) 
SO os ML ere 
WRITS (Ss, SYCy 2) PGURR (Eta, 2) 
SLSES22 (G 2 2OV) PCURRAI J, eel ReN 
WRetTe (5,220) PCURR(Z J, L),2 
ELSE 
WRITE (6,210) PCURR(I 0, h)),PCURR(T 0, url) 
ENDIF 
CONTINUE 
ENDIF 
CONTINUE 
CONTINUE 
TORMAT ('1 S@eeh, wid meer. 2 


Te taAIn™ ! 
TORMAT ( ( 


-- r 
-“ 


= 

= 

_ 
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Se 30 a S 

wo ~ _ —sjen- 

-< = 
= 
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rd 


SUBROUTINE: VMIN(RinG;) 9D, NOM VEN; seen, VOU L yer ou.) 


THIS SUBROUTINE: F ENDS [EE VECTOR MINIMUM® (THE SETSOF NON=SCME So cee 


> RCH THESWECCORS GUN 757 SND URETURNS@THE SOLUTION 97 BROUGH Wess, 
Tee ASSOCIATED PATHS a5 SENT IBY SEN AND RETURNED 2aROUGHe- ee 


X.<S THE NUMBER OF “JECTORS SENT TO VMIN,.-K IS TES NUMBER G2 Jala on eee 


=MPLICIT NONE 

-NTEGER CMAXT Coie, he EMAA, 1, NUM) NMAX =D 
PARAMETER (CMAX=4, PMAX=5C, NMAX=20) 

REAL VIN (PMAX,CMAX), VCUT (PMAX, CMAX) 

INTEGER PIN (PMAX, NMAX-1), POUT (PMAX, NMAX-1) 
LOGICAL VCOMP 

=XTERNAL VCCMP, VEQUAL, PEQUAL 


4 
i 
-_ 


2 


ci 3 


PE Rie bags 1) Lee 
CALL VEQUAL(VOUT,1,VIN,1,C) 
CALL PEQUAL(POUT,1,PIN,1,D) 
GOTO 60 

=NDIF 


TETUICCEO REL ETAR 
GOTO 50 

ELSE IF (VCOMP(VIN,J,I,R,C)) THEN 
GOTO 20 

ELSE IF (VCOMP(VIN,1I,J,8,C)) THEN 
GOTO 30 


2LSE 
GOTO 40 

=NDES 

See Ts 

IT aie oe 

GOTO 10 

ay ay Re slo ay 13) ponies tat 
CAL VEOUAL (VIN, J, VIN; R,C) 
CeO EOUA MPL sgl N, ro} 


PP(o 3EQ. R)l THEN 
CALL VEQUAL (VCUT, K, VIN, I 
CALL PEQUAL (PCUT, X, PIN, I 
% = K+ 


OM 


Sk ieee eaten! 


eC VCOMP (VIN, J, 2,R,C)) THEN 
CALL. VEQUAL (VOUT, K, VIN, J,©) 
CALL YVPEQUAL (2PCUT, KP PIN,J,>) 
SCTO 60 
BUSS50.5 §(VCOMP (VIN, T,.J,R,C)) “THEN 
CALL VEQUAL (VOUT, K, VIN,I,C) 
CALL PEQUAL (POUT, K, PIN, I,D) 
GOTO 60 


CALL YEQUAL(VCUT, K, VIN, 2,°C) 
CALL PEQUAL(PCUT,X,PIN,I,v) 


Mo Seg 
nee SEQUAINCI GC opt MeN, Oy ~) 


CALL PEQUAL (PCUT, K, PIN, J,)D) 
GOTO 50 
=NDIF 


CONTINUE 


NUM = K 
RETURN 


END 


JMIN 


ul 


LOGICAL FUNCTION VCOMP (MATRIX, 1,J,R,C) 


RETURNS 'TRUE!' IF VECTOR I OF MATRIX IS < (NOT STRICT) VECTCR J Gr MATa =z 
AND 'FALSE! IF VECTOR I IS NOT < VECTOR J OR IF VECTOR © = VECTOR 3 
IMPLICIT NONE 
INTEGER I, J, PMAX, CMAX, R, C, K 
PARAMETER (PMAX=50, CMAX=4) 
LOGICAL TEST, EQUAL 
REAL MATRIX (PMAX, CMAX) 
CES ores RUE 
SQUAL = .TRUE 
K=1 
CHECK FOR EQUALITY OF VECTORS 
DO S WHILE (SQUALY CAND. °K --LP. eG+l) 
Te (MATREK (2, Ke. LT. PMATREXK( C7 A) Se EN 
EQUAL =]@~sFALSE. 
Ko Sa 
SLSE @Sa(MATRIX (2,4) SGT. MATRIX(u,;A) J) THEN 
EQUAL = .FALSE 
TEST = .FALSE 
SUSE 
K = X+- 
ENDIF 
CONTINUE 
Cneck’ FOR: ENDTRYSMOFSU > ENTRYSOF =. 
CO. LORNEEEE A TEST) SAND = Kye Lt Cel) 
=F (MATRIX(I,K) .GT. MATRIX(J,K)) TEST = .FALSE. 
“eee Kt. 
CNG: 
ViGSMP = STEST we, AND owl sniG ae OO! 
RETURN 
=ND 
VCCOMP 
SUSRCUTINE VEQUAL (MATOS MATZ ome) 
SETS COLUMN = CE MATRIX MAT! SQUALL DO COLUMN DW OF MAT REN MAT eG Hae 


SPEC LaNONE: 

INTEGER 17 J, 2MAX, CMAX, Cy; RK 
PARAMETER (PMAX=50, CMAX=4) 

REAL MAT1 (PMAX,CMAX), MAT2 (PMAX, CMAX) 


DOStOs Kar .C 

MATL(I,K) = MAT2 (J, %) 
CONTINUE 
RETURN 


(G7) 


END 
VEQUAL 


SUBROUTINE PEQUAL (MAT1,12,MAT2,J,D) 


SETS COLUMN I OF MATRIX MAT1 EQUAL TO COLUMN J OF MATRIX MAT2 


IMPLICIT NONE 

INTEGER I, J, PMAX, NMAX, D, K 

PARAMETER (PMAX=50, NMAX=20) 

INTEGER MAT1 (PMAX, NMAX-1), MAT2 (PMAX, NMAX~-1) 


DO 10 K=1,D 
MATL (I,K) = MAT2(J,%) 
CONTINUE 
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Appendix B 


The Program TD 
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THIS PROGRAM FINDS THE NONDOMINATED PATHS IN A NETWORK WITH TIME DEPENDENT 


VECTOR COSTS USING FORWARD DYNAMIC PROGRAMMING. 


VARIABLES 
N NUMBER OF NODES IN THE NETWORK 
M NUMBER OF LINKS IN THE NETWORK 
C NUMBER OF COST COMPONENTS TO A LINK 
PTR PTR(I) TELLS WHERE TO LOOK IN STNODE FOR LINKS 
LEADING TO NODE I 
STNODE STNODE (J) GIVES STARTING NODE OF LINK J 
T T(I) IS THE TIME WHERE THE STEP IN LINK I OCCURS 
TIME TIME IS THE TIME REQUIRED TO REACH A SPECIFIED NCTE 
LCOST LCOST (I,J) IS THE JTH COST COMPONENT OF LINX I BEFORE Tre TIC; 
UCOST UCOST (I,J) IS THE JTH COST COMPONENT OF LINK I AFTER TIME 7T(CZ) 
sxxex (THE FIRST COST IN EACH VECTOR IS THE TIME TO TRAVEL THE 171%) 


a ee! Lend 


PCOUNT (CCOUNT) PCOUNT(K) (CCOUNT(K)) IS THE NUMBER OF NCNDCMINATEZ PATHS 


THAT LEAD INTO NODE K BEFORE (DURING) EACH ITE 


PPREV “(PCURR) Pere win, a) ) (PECURR(I,J,K)) IS .THE ATH NODE IN THe 


JTH NONDOMINATED PATH FROM 1 TO I BEFCRE (LURING) 


EACH ITERATION 
NOTE: BPREV(, dh, by (PCURR(1,J,1)) “2£S*THa" NUMes> 


ten | TS er ~a7 


ees 
ve aduseliser aot 


JTH NONDOMINATED PATH FROM 1 TO I BEFORE (DURING) 


ZACH ITERATION 
FDREV (FCURR)  FPREV(I,J,X) (FCURR(I,J,K)) IS TH 


NODE I BEFORE (DURING) 


eee os) NONE 

Sito sGsRon, ONMAK OM SeMMAX, C, CMAX, PMAX, 1,J,&,A,3,2,%, NUM 
PAFAMETER (NMAX=20, MMAX=100, CMAX=4, PMAXK=50) 

INTEGER PTR(NMAX+1), STNCDE (MMAX), PCOUNT (NMAX), CCOUNT (MMAX) 
INTEGER PPREV (NMAX, PMAX, NMAX-1), PCURR(NMAX, PMAX, NMAX-1 ) 
INTEGER PMAT (PMAX, NMAX-1), PSOL (PMAX, NMAX-1) 

REAL 3IGM, MATRIX (PMAX, CMAX), SOLN (PMAX, CMAX) 

REAL LCOST (MMAX, CMAX), UCOST (MMAX,CMAX), T (MMAX) 

REAL FPREV (NMAX, PMAX, CMAX), FCURR(NMAX, PMAX, CMAX) 

REAL TOME,. COST 

EXTERNAL COST 


Cou ReAD(N;M,C, SUR; SINGDE COST, UCOSE, tT) 


INITIALIZE PATH COUNTS AND FUNCTIONAL VALUES 


bdo 
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~ 
3 (O) 


| 
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te 
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oO 
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HZ 


Lia) = oer 
CONTINUE 


INITIALIZE PATHS 
DO 25 I=1,N 
SO 27 J=1,N-1 
PPREV(I,1,J5 
CONTINUE 


CONTINUE 


| 
oO 


TRE 
TRE eR HaCOSleCOMPONENT SPOR Tan ort PACs Say 
mA 


_ we 
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50 


40 


30 
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IF A LINK (1,J)_ EAlTStS; RESNT TIA ros 
Joe ed 
DO 30 I=1,M 
IF (STNODE(I) .EQ. 1) THEN 
EF (PTR(JtL) .GT.) 2) Lae 
DO 40 A=1,C 
FPREV(J,1,A) = LCOST(I,A) 
CONTINUE 
PPREV(J,1,1) = 1 
ELSE 
J = Jt+l 
GOTO 50 
ENDIF 
ENDIF 
CONTINUE 


FCRWARD DYNAMIC PROGRAMMING 
NEZD «N-LenTERATIONS 


SC).60 Kel N- 
WRT TEs(6; 2) 
ARETE (65/998) =A 
NRITE (5 29944 


FOR NODES 2 TO N 
DO 79 2=2,N 


STORMS AGA tereretvmel SJ) 
Z=0 
DO 80 J=PTR(L) cinta). pee 


FUNCTIONAL VALUE AND 


AND FOR =ACH PATH TO NODE J 


CO 90 A=1,°COUNT (STNCDE( J} }-~ =" 


aNO COST. OF EACH PATH TO NODE 1 


MATRIA(Z,3) = EPREV (STNODE (J) -A, 58) 


+ COS T(G75, 1 Me, eCOST ,UCOsr a) 


CoN. oNUs 


ADD ONE TOC THE COUNT OF NODES PER PATH 


EMAT (2, 2) = or PREY CST NODE} 


Peay Ga ee 


GET NODES IN EACH PATH TO NODE J 
DO 10S e8=27 -MATAZ, os eee 
MAT (G5) = PREV (StNCUE(d) A,5) 


CON as al NUE 


Oe ed hen! 


CONTE AGS 
OD adn! 
CONTINU 


FIND VECTOR MIN OF ALL PATHS 


CALL VMIN(Z,C,N-1,NUM, MATRIX, PMAT 


UPDATE COUNT OF PATHS TO NCDE 


CCOUNT (I) = NUM 


FORMEACH Shon 
DO 110 A=1,NUM 


AGE Last NCDE FOR NENVPATH 
rd oF WA Ja) A SHAR ©1831) Go 


7, SULN, PSOL) 


rT 
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(DEPENDS ON 


PATH 
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UPDATE FUNCTIONAL VALUES 
DO 120 B=1,C 
FCURR(I,A,B) = SOILN (A,B) 
. CONTINUE 


AND UPDATE PATH 
DOel25eb=r, NL 

PCURR(I,A,3B) = PSOL(A,B) 
CONTINUE 


OUTPUT NODE, PATH NUMBER AND FUNCTIONAL VALUES 
WRITE (6, 999) I,A, (FCURR(I,A,5B) ,B=1,C) 
CONTINUE 
CONTINUE 


SET PCOUNT = CCOUNT, FPREV = FCURR, AND PPREV = PCURR 
DO 65 I=2,N 
PCOUNT (I) = CCOUNT (I) 
DO 66 A=1,CCOUNT(I) <-" 
DO 67 B=1,C 
FPREV(I,A,3) = FCURR(I,A,B) 
CONTINUE 
DO 68 B=1,N-1 
PPREV(I,A,B) = PCURR(I,A,B) 
CONTINUE 
CONTINUE 
CONTINUE 


GOLLOSNEXT ITERATION 
CONTINUES 
SCORMAT (MZTERATION ',..74) 
ECRMAT ('NCDE PATH NUMBER FUNCTIONAL VALUES ') 
FORMAT (I4, 19, 4F10.i) 
ITE RESULTS TO 'NETWORK.OUTPUT' 
CALE OUTPUT (N,M, C, =CURR, P>COUNT, PCURR) 


=ND 
MAIN PROGRAM 


SUSROUTINE READ(N, M, C, PIR, STNODE, LCOST, UCOST, T) 


THIS SUBROUTINE READS IN THE NETWORK =RCM TSE FILE 'NETWORK.DSATA' 


aMeuloLl teNCNs 

INTEGER NMAX, MMAX, C¥AX, N, M, C, I, J 
PARAMETER (NMAX=20, MMAX=100, CMAX%=4) 

INTEGER PTR(NMAX+1), STNODE (MMAX) 

REaL LCOST (MMAX, CMAZ), sCCST (MMAM, CMAX), T (VMAX) 


OPEN (2, FILE='NETWCRK.DATA') 
OPEN (6,FILE='NETWORK.OUTPUT') 


READ NUMBER OF NCDES, NUMBER OF LINKS, AND NUMBER OCF COST COMPCNEXTS 
READNZ,*) N,M,C 


READ POINTER LIST 
READ(2Z, FI GUPTR(IM, Sel, Nz 2) 


READ STARTNODE LIST 


) 


30 


(@) 


aa 


Om 


READ (2,*) (STNODE(I),I=1,M) 
READ IN COST OF EACH LINK 

DO 30 I=1,M 
READ (2, *) \(LCOST.(I, J), J=1, €C) 
READ (27 *7™ (GCOST (1,3) ,J=l,C) 
READ (2,*) T(I) 

CONTINUE 

RETURN 


SUBROUTINE*OUTPUTAN Fei, © CURR, PCOUNT, PCURK} 


WRETES RESULTS TOM NETAORK OUTPUT | 


Mee LUC Te NONE 

INTEGER’ NMAX, MMAX, CMAX, PMAK, N, © 
PARAMETER (NMAX=20, MMAX=100, CMAX=4, PMAX=50) 
INTEGSR PCOUNT (NMA), PCURR (NMA, 2MAX, NMAX=2) 
REAL PCURR (NMAX, PMAZ, CMAX) 

moka GASES, PERO EX 5s 


WRITE (6,*) 
WRITE (6,100) 1 
WRITE (6,110) 1 
20 108r=27N 
DO 20 J=1,PCOUNT(Z) 
WRITE (6, *) 
WRITE (6,100) I, (FCURR(I,J,K),K=1,C) 
IF (PCURR(I,J,1) .=Q. 1) THEN 
WRITE (6,119) 1,2 
ELSE 
DO 30 L=1,PCURR(I,J,1) 
IF (L .EQ. 1) THEN 
WRITE. (6/220) APSCURR (at 2) 
SLSE <F(L .20# PGuRRiG opal 
WReT= (5, 220) (SCURRIT) J) LE) y= 
rege 
WRITE (4,210) PCURR(I,J,L),2CURR(Z,J;/5+2) 
ENDIF 


sa 
CONTINUE 
SORMAT (lor? 
1 


REAL FUNCTION COST (1, J, TIME/LCOST, UCOST, T) 


THIS FUNCTION RETURNS THE UTH COST ELEMENT OF ZINK Tf AT 
THE STEP FUNCTION "DEFINED FCR SINK I 


=MPLICiIT: NONE 


SN eos 


BYJUSE 


Sse 


Yome 


= 


Cry Oey @ 


30 


INTEGER MMAX, CMAX, I,J 
PARAMETER (MMAX=100, CMAX=4) 
REAL LCOST (MMAX, CMAX), UCOST (MMAX, CMAX), T (MMAX) 


ST Ok tO} A il QU) a Berg Yl oH) 
SOST <= UCOSE(1l7J) 
ELSE 
COST = LCOST (I,J) 
ENDIF 


SUBROUTINE VMIN(R, C, D, NUM, VIN, PIN, VOUT, POUT) 


THIS SUBROUTINE FINDS TEE VECTOR MINIMUM (THE SET OF \NON-DCMINATSsS. JECrIC3$S) 
PROM TRE VECTORS IN VIN AND RETURNS THE SOLUTION THROUGH VOUT. 
Pee ngoCC lA aD PALMS) eke OENT BY SIN AND RETURNED THROUGH 2CUz. 


Reo oOo NUMBER On YaC TORS. SENT TO VMIN, KS) THE @NUMBERAC Tl svakaeroece. Slt. 


ae sels «NONE 

See Genco e, His pa, IP MAX, 8, NUM, NMAX, 3 
PARAMETER (CMAX=4, PMAX=50,NMAX=20) 

REAL VIN (PMAX,CMAX), VOUT (PMAX, CMAX) 

INTEGER PIN (PMAX, NMAX-1), POUT (PMAX, NMAX-i) 
LOGICAL VCOMP 

SATERNAL VCCMP, VEQUAL, ?PEQUAL 


Bee (he EQ.022)) THEN 
CALI pee aaah ale) 
Ae Bee as page ets oy D) 


SOTS 30 


wee Oe ena eT HEN 
GOTO 50 

Succentl=a(VCCMP (VIN, J,i,%,C)) THEN 
GOTO 20 

EGSEs LE. s(VCOMP (VIN, Lyon, c)) THEN 
GOTO 3 


CALL VEQUAL (VIN, J, VIN, R, C) 
CALL PEQUAL (PIN, J, PIN, 8, D) 
ENDIF 
R= R-l 


40 


50 


MO 


(@) 


GOTO 10 


fees EOo nh) Erne 
CALL VEQUAL (VOUT, K, VIN,T,C) 
CALL PEQUAL (POUT, K, PIN,I,D) 
K = K+l 


GOTO 20 

ELSE 
J = Jtl 
GOTO 10 

ENDIF 

IF (VCOMP (VIN,J,1I,R,C)) THEN 
CALL VEQUAL (VOUT, K, VIN, J,C) 
CALL PEQUAL (POUT, K, PIN,J,D) 
GOTO 60 

ELSE IF (VCOMP(VIN, 1,0,2,Ch)) then 
CALL” VEQUAL(VOUT, KIYIN, £7C) 
CALL PEQUAL (POUT, K, PIN, 2, D) 
GOTO 60 

so Os 
CALL’ VEQUAL (VOUT, K, VIN, I;C) 
CALL PEQUAL{POUT PK fear; >) 
K = K+l 
CATE PVEOCrs (yOu nase ails iy ) 
CALT PEQUAS (POUT) Ay PIN, J, 0) 

STO 60 


=NDIF 
=NULE 


ANIM T = 
ONT INUE 


NUM = K 


RETURN 

=ND 

VEN 

=OGiCAL FUNCTION: JCOMP (MAPSENpap er cy 2) 

RETURNS) YT RUS Geek vec One 2 Ole Maa a. 

AliD’ “PALSE Psee JE CTOR “ber caNO pci =e on res 


sMPLeCity NCNz 


INTEGER I, J, PMAX, CMAX 
PARAMETE 


LOGICAL 


R (PMAX=50, CMAX=4) 
TEST, EQUAL 


REAL MATRIX (PMAK, CMA) 


id 
a 


NU) +] 
Om 
i qn 


CHECS PORSECUALG I (Ob VEcrens 


DO 5 WHILE (EQUAL .AND. 
LES AMATRIA ( hrc) succes: 


Fe mei eR eA) 


EQUAL ="{ FALSE. 
Set Sa 
ERoe LE MMATRERCL Ay) .comeMAL ste, ov) 
EQUAL = .FALSE. 
TEST a= +. FALSE: 


ELSE 


MAA ES 9 26)) 0 aN 


=S-< (NOT soe 


THEN 


VECTOR J (OF 
= VEC 


DOR ui 


MAscag ca 


ayreth wiaoe 


10 
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K = K+l 
ENDIF 
CONTINUE 


CHECK FOR ENTRY OF «J > ENTRY OF I 


DOr LO. WHILES(TESD MAND. Ko.uL. Cri) 
TEO(MATRIX (17K) eGl.  MATREX (J,h):). ‘TEST = a.FALSE, 
K = K+l 

CONTINUE 


VCOMP = TEST .AND. (.NOT. EQUAL) 
RETURN 


END 
VCCMP 


SUBROUTINE VEQUAL (MAT1,1I,MATZ,J,C) 


Seon a pe, eek, CMAX, C, K 
PARAMETER (PMAX=50,CMAX=4) 
REAL MAT (PMAX,CMAX), MAT2 (PMAX, CMAX) 
30 10 xK=1,C 

MATL (I,K) = MAT2(J,K) 
CONTINUE 
RETURN 


END 
VEQUAL 


SUSBRCUTINE PECUAL(MATL,2,MAT2,J,5) 


SETS CCLUMN I OF MATRIX MAT! EQUAL TO COLUMN J OF MATRIX MAT2 (FCR 
ESP LLCLT NONE 

INTEGER I, J, PMAKX, NMAX, D, K 

PARAMETER (PMAX=50, NMAX=20) 

INTEGER MATI (PMAX, } -1), MAT2 (PMAX, NMAX-1) 


DO 10 4=1,D 
MAT1 (I,K) = MAT2(J,K) 
asl sate S 


RETURN 


END 


SEQUAL 
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Appendix C 


Sample Input Files 
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The following input file is for the network representing the building in section 6 
with time dependent vector costs. The 34 vector costs have three components: 

the lower step, the upper step, and the time where the steosoecweas 
Executing TD with this data file will produce all nondominated paths from nede 1 


to every other node. 
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Sample Output Files 
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This output is for the time dependent vector cost fire egress problem 
in section 6. 
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